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CHAPTER 1 
Introduction 


This thesis presents the detailed desian specifications 
for a mechan! sm to handle absentee (or background ) computations 
ina multiple-access computer ersten. The mechani sm operates 
as a package of self-contained modules with a minimum of 
dependencies upon the environment in which it resides. Thus, 
it may be inserted into any existing multiple-access computer 
system which has the proper environmental features, 

The work of this thesis is ‘concentrated in several areas.. 
First, those features which are ‘desirable in a system for 
handling absentee computations are considered, Many of these 
features exist in current working systems, but several new 
features | are proposed. 

Second, the overall design for a new type of absentee 
mechani sn is considered. mme functions of each module in the 


mechanism are discussed, and interfaces detween this mechanism 


and other parts of the iii 88 system are 
defined. 

Next, the detailed design is presented for the two major 
portions of the new absentee handling mechanism, This design 


is interesting for several reasons: 


1 - Absentee computations are supported in a system 
designed for time-sharing applications. 

2 - The amount of absentee usage on the system may. 
be carefully regulated to comprise anywhere from 
0% to 100% of the total absentee and interactive 
system usage, . 

3 - The portion of system usage assigned to absentee 
computations may be further subdivided and assigned 
to absentee computations of various types“. This 
provides for ease in implementation of priority 
schemes for determining which computations ‘should 
‘currently be serviced by the system. 

4 =| The apportionment or systen usage is made flexible 
by the absentee handling mechani en to prevent waste 
of available computing capability, ö 

5 = Computations of a particular “type are always 
guaranteed first claim to the portion of system 
usage assigned to them. . 

6 = The mechanism may temporarily suspend and then 

_ automatically resume an absentee computation thus 


making such interruption. transparent to the computation, 


la 


This ability is useful in providing the 
apportionment flexibility mentioned above. 
Pinally, an attempt is made to specify a compact 
set of commands for users and administrative personnel. 


The commands are designed to provide smooth interaction 
with the facilities ani capabilities of the proposed 
absentee handling mechanism. In particular, comands 

are provided to perform certain obvious functions such 

as creating and terminating abeentes computations, and 
certain functions unique to this application such as 
converting an interactive computation to abeentee and vice 
versa, and specifying the apportionment or axsten usage 
between interactive and absentee computations, 


1.1 Terminology 

A time-sharing computer sten rapidly shares its 
resources. among many users to give each user the illusion | 
that his computation is constantly running. An intexsotive 
user controls the operation of his computation by isauing 
commands (usually in the form of statements typed at a remote 
teletype termina) ) to the system, observing the system's 
response to each command, and issuing further commands based 
on previous responses. An absentee user does not have to de 


1b 


present at a terminal to control his comptation; 
he submits a file f commanis which specify the operation 
of his job, The system MA (1. , ‘maintains an ordered 
list of) each of these descriptor files as they arrive, 

me concept of a commuter utijity 2s that ee 
providing accessible computing capability to a large number 
of users (referred to as the . on a twenty- 
fourshour-per-day , seven-day-per-week ‘basis, ‘It 28 normal 
to expect, however, that malfunctions aay require that the 
system undergo an occassional AMA eo that the malfunction 
may be repaired, To resume normal operation, the system 
undergoes a gtartup procedure, 22 

Each user of the system may store information in 

private files (usually space on secondary storage media 
reserved for this user). A potential user of filed 
information must identify himself to the system: by typing 
a secret — thus preventing wautherirea persons 
from using the system, ‘This identification procedure 1s 
referred to as An- in. en u user is finished using 
the system he loge out to inform the system that he no 
longer needs its resources, 
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Unless otherwise specified, files are used to supply 
Input to and receive output from absentee souputations 
since such computations are generally not attached to 
terminals, However, the user may desire to receive input 
to his absentee computation from a private mwagnetic tape 
in which case his computation may run only if a tape drive 
is available, The tape drive in thie exemple is referred 
to as a dedicated zegource since it must be specifically 
assigned to this user for the duration of his sonputation. — 
To assure that a required dedicated resource 16 available 
when it is needed, the user places a reservation (via the 
system) to use the resource during a specific time period. 

Non-time-sharing computers generally handle jobs in 
a batch processing format: the jobs are sutmttted in the form 
of card decks or magnetic tapes at a central computer 
installation and are processed sequentially, either one 
at a time, or in the case of recent multi-precessing systems, 
several at a time. 

The System 1oed on a time-sharing computer systen 
which services both interactive and absentes computations 
refers to the current demands for service to all computations 
on the system, When the load decreases more computations 
may be initiated to push the load back up to peak efficiency 


operating levels. At any instant during 


the operation of the system, requests for service are . 
enqueued on a priority basis (seheduied), and the request 
at the head of the queues is the first to be serviced. 
Priorities are generally assigned to computations 
to indicate some sort of preferential ordering for service, 
‘Mimiseion priorities are used by the system to determine 
which of several computations attempting to log in should 
actually be allowed to log in to the system, Scheduling 
Priorities are used by the system to determine which’ 
of several logged in computations should be given service 
y a processor when that processor becomes available. 
Admission priorities are generally fixed whereas scheduling © 
priorities are dynamically computed at execution tine. 


The concept of providing absentee usage facilities 
in a time-sharing environment is not new, but the general 
design principles have not yet been discussed. ‘Two of 
the earliest successful attempts in this area are: 


* * 


The Compatible Time-Sharing System (1,15 ) 
implemented on the IBM 7094 by k. 1. T. in 1962, 
Absentee capabilities were included in the 
original design of C. T. 8. 8. The ability for 


an interactive user to initiate an absentee 
computation | was added in 1963-1966. 

Time Sharing System/360 (4,5) implemented by 
IBM on its 360/67. Absentee capabilities 
were included in the original design for which 


a prototype implementation became available 


in 1967. Some notable features of the TSS/360 
implementation include the ability for 

a user to interrupt his running interactive 
computation and convert it to absentee, and 
the ability for a user to initiate a wide range 
of bulk input/output operations via commands 


mich may be issued by interactive or absentee 


computations, These tulk input/output requests are 
handled as standard absentee computations 281 

are enqueued until the input / out put devices 

needed to service the requests become available. 


The absentee handling mechanism designed in this thesis 
is being implemented as an integral part of the “Multics" 
system (Multiplexed Information ané.Computing Service) under 
development at Project MAC at the Masseaahusstts Institute 
of Technology. Multics 18 being designed and implemented 
as a general purpose time-sharing operating system for the 
computer utility. The reader interested in exploring Multics 


further should consult a group of papers (5,6,7,8,9,10) 
which were presented at the Fall Joint Computer Conference 
in 1965. Project MAC Technical Report- 30 (4) contains a 
discussion of the organization of the computer utility 

and a deseription of the basic design of the Multics system. 


Chapter 2 discusses those features which are desirable 
-in a system which supports absentee computations, and the controls 
that users and system administrative personnel should have 
over absentee computatione, 
Chapter J presents a block-diagram overview of the 
absentee handling mechariism, and discusses the functions 


performed by each of the modules in the mechanism, 

Chapter 4 develops the concept of a computation stream 
and then illustrates how several such streams may be combined 
to form a rn mul tiple- stream queueing mechanism for 
absentee computations. 

Chapter 5 considers the problems of regulating the 
system load in a system which supports both interactive 
and absentee computations, <A mechanism for performing the 
load control function is proposed which utilizes the 
flexibility of absentee computations to assure that the 
load remains close to its most efficient operating level, 
The mechanism allows the computing capability of the system 
to be allocated in any proportion between interactive 
and -abeentes computations, and provides the ability to 
quickly and smoothly adjust the system toa new load 
reapportionment, | 

Chapter 6 presents a set of commands for users and 
administrative personnel to create, control, and terminate 


absentee computations, 


CHAPTER 2 


Peatures of Absentee Computations 


This chapter defines-absentee, interactive, and batch 
computations, and discusses the similarities between absentee 
and batch computations, the features of abseites ctmputations, ani 
_ the facilities of the absentee handling mechant sa. 


22.1 Computation Modes af 

A user may run hig computation in either of two modes, 
namely interactive or gheentee. 

An interactive commutation (1c) 1s controlled by a user 


who enters commends at a remote terminal, receives responses 
from the system at that terminal, and enters additional commands 
based on previous responses. The interactive mode affords the 
user precise control over his computation and allows the user to 
make major changes of strategy at run tine. The interactive j 
mode is particularly useful. for program debugging and for N 
implementing programs which talk with non-programer users 
(administrators, scientists, flight reservation personnel, etc.) 


An gbsentee computation (AC) does not require interaction 
with the user. The user sutmits an absentee computation as 
a file of commands (sbsentee source file) basically identical 
to the comands: the user would enter if wunning the same 
computation interactively. The absentee node frees the user 
from having to be present to control his: computation and 


is particularly useful for running checked-out programs and 
“production” runs. e 

A batch computation is basically identical to an absentee 
computation except for the manner in which the file of commands 
is submitted to the system, An absentee source file is | 
generally submitted vie a remote terminal, wheress a batch 
computation: command file is generally subteitted in the form 
of a card deck at the central computer installation. 


An absentee computation. may be initiated for user dy one of 
the user's interactive computations, another of the user's 


absentee computations, or.a.vatck-comphtation: aste by the user. 


user's absentes edhputatiohs aay de: tePminated: by ‘any r 
that user's interactive or absentee computations. . 

A user may specify. (for his om pretection) any. running time 
limit for each of his AC's. If the time limit is exceeded, the 


system automatically saves the AC so that partial results are not lost, 


If the user does not specify a time limit for an AC, then a default 


value is assumed by the system, again for the user's protection, 


_ & computation (IC or AC) of a particuler user may obtain 
status information about any of that user's computations (both 
IC's and AC*s). Detailed information about each of a user's 
40 is always available to that user, regardless: of whether 
his Ac“ are waiting to be run or are currently running. . 

An interactive user may interrupt his IC at any point and 
convert it to an AC, This feature ts desirable in the case 
that a user wishes to start his program interactively to make 
sure that 1t is working properly, and then dirt the progres 
to absentee so that it may continue to completion without the 
user's attention. | 

im interactive user may interrupt any one of his ace at 
any point and convert it to his current IC. This feature is 
useful in the dase that the user wants to-monitor the progress 
made by his absentee computation, or perhaps make some run- tine 
changes in either the program or its data. In some cases, the 
user may convert a computation from abesntes to: interactive. to 
get a higher priority for the conpatation so: that: the computation 
may be completed sooner. 

The system administrative personnel. may terminate any AC. 
(or IC) whieh appears to be a “troubdlemaker*. . 

The system aéministrative personnel may specify an 
apportionment of system resources tetweeh AC*s anf IC's 
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in order to emphasize a particular mode during certain: periods 
of system operation. In effect, this apportionment. partitions 
the system into two distinct. sub-systems, one for running AC‘s 
and one for running IC*’s, The AC-IC apportioment may renge 
anywhere from O- 100 to 100%-0%, 

A user may have many running AC's (and many IC's) at one 
time, but the number oan de administratively limited, In the case 
that a single user has several IC“ at various terminals, each of 
the IC's has qual control over any of the user's AC's, 

Input to an AC is normally taken from the appropriate 
absentee source file, Output from an AC normally goes to a 
user-specified ebeentee output file. The. user may alternatively 
specify dedicated resources (in plane ef fites) for AC. input/output. 

A user regttrifg. dedicated ‘resources fer use by any of his 
a0 shob2A Place an advance reservation for the resources. 


2.2 System Features 

The system enquehes user requests to initiate new AC's 
so that these AC's may be initiated in the future at a tine 
which the systen feels is opportune. 

The systen may temporarily suspend service to a number of 
AC*s so that an increased load of 1e · 6 may be more effectively 
serviced, Similarly, the system may “bump” a mmber of IC's 
so that an increaged load of AC's may be serviced. Bumping an IC 
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involves saving the IC in its current state and automatically 
logging out the user. To continue a tyumped IC the user mat 
log: in again and specify that the bumped IC be resumed. Af ter 
a user has been bumped, he will often find that he cannot log in 
again immediately. This occurs because the nost frequent. 
reason for bumping a user is to decrease the system load. and 
maintein the ldad at its lower level. ; 

The system may automatically resume service to suspended 
‘AC*s when the IC load decreases. (Note the asymmetry here. A 
suspended AC 18 always automatically resumed by the systen 
while a bumped IC can only be resumed by the interactive user 
himself. This property 1s oritical to the process of. dynamic 
load balancing discussed in Chapter 5.) 

Jobs may. be submitted to the system in a batch-proceasing 
format as a deck of cards. Such jobs, efter undergoing a 
procedure to walidate the identity of their originators, are 
handled by the absentee mechanism in the same mamer as AC's 
requested by IC°s or other AC's, 

The system makes shutdowm transparent. to Acts dy 8 
any AC*s running at shutdown and automatically resming the 
suspended AC“ at startup time. Any AC's which are sitting in 
the queues waiting to be run at ehutdom, remain anqueved during 
shutdown and may be initiated by the system af ver startup. 
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The apportiomment of resourves: between AC's and IC“ is 


normally done for various long periods of system cperation 
called shifts. However, the demands made by AC's and IC's 

upon the systen eves the short term may vary significantly . 

and frequently. The system catere to short term variations 

in demand by making modifications to the resource apportionment 
over short periods called integration pertods.. The Load 

Control mesktanion (see Chapter 5). compares the ourrent denands 
upon the syatem with the current: shift's resource apporticnment, 
and makes necessary adjustuents in the AC-and IC loads to insure 
that good quality service is provided to all ruming computations 
regardless of any ‘short-term surges in-demand, For example, if 
the Ac-Te apportionment is 25%-75% and the AC demands decrease 
to only 20%, then Load Control ‘allows enough new IC's to be 
initiated to bring the IC usage up to 80%. When the short«term 
variations are of greater magnitude, Load Contrel may. elect 

not to match a decrease in one mode of usage th an equal 
inorease in the other. Instead, it. may match a 20% decrease with 
only a 10% increase, This provides: a camping. effect. which helps 
to prevent the current usage of syatem: resources from varying too 
significantly from the desired shift resource apportionment, 

See chapter 5 for a more precise discussion of the load 
balancing operations performed by Load Control. 
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The system keeps track of all. AC‘s: requiring dedicated 
resources to be initiated. Whenever a reservation made for 
a particular AC becomes due, the system automatioglly initiates 
that AC. | 


In a system in which many computations are siaultenecously 
competing for service, it is desirable to provide some sort of 
priority mechanies. to allow a user to express the relative 
importance of his computation. The user is provided with a 
oho of priority streams, in which he may request his aC be run. 
High priority stress provide service at higher cost, while 
low priority stress may provide slower service wt at reduced cost. 
If the user does not specify in which priority stream he wants ö 
his computation to run, the system automatically.inserts the. 
computation into the stander) stream. Since absentee 
computations do not necessarily have tobe initiated immediately, 
a series of waiting queues is “provided, one for ach priority 
stream. When Load Control decides that more absentee computations 
may run in a particular stream, it informs the.mechanisgn which 
handles the absentee queues to initiate an apprepriate nunber 
of absentee computations from the waiting queue for that strean. 
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CHAPTER 3 
Overview of the Absentee Monitor 


The Absentee Monitor éonsists of a group of related modules 
and a series of queues which together are respohsiBle for the 
enqueveing, initiation, control, and termination of absentee 
computations. This chapter discusses the major sections of the 
Absentee Monitor and the interrelationehip between the Absentee 
Monitor and other parts of the nul tiple- access computer aysten. 
Figure 3.1 illustrates the structure of the overall mechani am 
for handling absentee computations, Chapters k, 5, 6, ami 7 
describe the parts of the mechanism in greater detail. 


3sj Major Sections of the Absentee Monitor 

ne Absentee Monitor consists of three modules end two 
sets of queues, one queue in each set being assigned to service 
each priority stream, Chapter 4 diseusses the queueing mechani sz. 
in detail. | 


223.1 Absentee Queue Contro) 


As new requests to initiate absentee computations are 
entered by users into the systen, the names of the corresponding 


15 


91 


Absentee 
Initiation 
Module 


Absentee 


Waiting 
Queues 


Absentee 
Queue 
Control 


Absentee 
Running Absentee 
Shelving 


Module 


Queues 


Reserver 


Figure 3.1 ö 
Mechanism for Control of 
Absentee Computations 


System 
Control 


absentee source files and absentee output files (and other 
additional useful inforsation) are placed into queues where 
they remain until such time as the system decides to initiate 
additional absentee computations. Ab oa ie the 
system module responsible for. making eee 3 in the 
queues, retrieving entries when they are neeted by. other parts 
of the absentee mechaniam, and deleting entries which are no 
longer needed, 


2.1.2 Absentee Waj ting Quoues 

The Absentee Waiting queues are = series. of queues, one 
pér priority stress. which contain the per computation information 
for absentee computations waiting to be initiated, 4 user. 
request to initiate a new absentee computation causes Absentee 
Queue Control to make an entry for this computation in the 
appropriate Absentee Waiting queue. | 


3.4.3 Absentee Ruming Gusues 

The. sbeentes Running queues are a series of queues, one 
per priority stream, which contain the per computation information — 
for each running absentee computation, When an ne tee computation 
is initiated, Absentee Queue Control deletes the corresponding 
entry from the appropriate Absentee Waiting Queue,and inserts 
an entry in the appropriate Absentee Ruming Queue, 
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321.4 absentee Initiation Module 
Whenever sore absentee computations say be initiated, Load 


Control (see Chapter 5 and section 7. 2. 3 below) informs the © 

peentes Initiation Noduie of the number of AC's to initiate, 
The Abschtee: Inttistion nase decides witeh ACs to initiate 
end nekes ‘the appropriate calls to initiate them. ‘The Absentee 
Initiation Nodule calls Absentee Queue Control to make the 
appropriate insertions (deletions) in the Absentes Ruming (Waiting) 


Queues, 


eres ter, the short-term suspension of absentee computations 
referred to in Chapter 2 1s berned hn ‘the absentee 
computations, The distinction between a shelved computation 
and a computetion which has merely-deew ved is tet a shelved 
computation is only saved temporarily until sash tine as the 
system decides to continue it, whereas a saved computation can 
only be continued if the: user 10% 1 Aneexestively. ant orders 
such aetien. “Unghelving" ‘te the preness of xemming a shelved 
eempatation and is performed automatically dy the Abuantes Noni ter. 
Whenever it becomes necessary to decrease the nunber of 
purning AC's, Load control informs the gpyentes Gisiving Nodule 
of how many AC's to shelve. he Able Bhelving Ro@ule decides 
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which AC's to shelve and makes the necessary calls to ahelve then. 


Absentee Queue Control is called to make the appropriate 
insertions (deletions) in the Abgentes Waiting. (Running) 
Queues, Mote that shelving an AC involves placing an entry 
for it back into the appropriate Absentee Waiting Queue so that 
the AC again becomes a candidate for initiation by the Absentee 
Initiation Module, | | 


BT, FVP a 
This section discusses the environment: ‘of the absentee 


mechanism, Load Control is discussed here instead of in 

section 3.1 only because its functions are related to both 

Ic*s and As. However, Load Control is a critical portion 

of the absentee mechanism and is discussed in detail in chapter 5, 


System Contre), is the module which processes command requests 
from the eyaten administrative personnel. In particular, arse 
Control sotiveys the AC-IC apportionment information frou 
the System Administrator to Load Control; and the dedicated 


resource apportionment information to ‘the Reserver. 


3,222 Performance Measurement 
Periodic determination of the current amounts of interactive 


19 


and absentee usage being supported dy the system ia essential 
to the operation or the load-balancing mechaniem, Perforsance 
Measurement obtains these usage statistics by observing various. 
system parameters and conveys the information to Loa Control. 


2e211Loed Control 
The main functions of the Load Contro] module are: 


1 = to see that the apportiomment of resources between 
Atera tive and absentes computations vemains close 
to that specified dy the system nini strator 
2 = to cater to short-term variations in the demands 
upon the system's resources by dynamically varying 
the current resource apportionment 
3 = to see that the system is neither. under nor over 
loaded. 
Load Control compares the apportionsent Smt Omer on. it receives 
from the System Admini strator with the current use statistics 
supplied by Performance Neasurenent, If any ‘Significant discrepancies 
exist between these sets of figures, then Load Control may modify 
the system load by any of the following means: 
1 = call the Absentee. Initiation Module to initiate 
| more 408 | | 
2 = call the Absentee Shelving Module to shelve some AC's 
3 - - increase the. matinun number of IC‘s allowed 
1 = decrease the maximum number of IC's allowed 
5 = automatically log out some IC's 
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3,2,4 Load Control Table 


In this table, Load Control maintains a list of all logged-in 


IC*s and certain additional information such as the total number 
of logged-in ICs ami the marimum number of IC*s which the 
system currently allows. During the load~belanocing operations, 
Load control obtains’ information about 40 from the Absentee 
Waiting Queues and the Absentee Rumming Queues afi about IC's 
from the Load Control Table, 


2.225 Beserver 

The RBegerver is responsible for scheduling the usage of 
dedicated resourees (for both I“ anf AC's), If à user's | 
AC requires dedicated resources, the user must place an advance 
reservation for the resources, The systen autosatically 
initiates the AC when the reservation becomes due. 


322.6 SAVE, RESUME, and QUIT | 

These mechanisms are provided in the multiple-access computer 
system to facilitate certain manipulations of computations useful 
to both AC*s and IC°s, QUIT is called to stop the execution 
of a computation and place the computation into a state in which 
it may be easily preserved, lost, or continued, I 18 used to 
preserve the. computation ih. ite sukpent state so that the computation 
may be continued in the future. RESUME is used to continue 
a SAVEd computation. 
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Shelving an AC involves first QUITting the AC, then SAVEing 
it, deleting the Absentee Rurming Queue entry for it, oreating 
an absentee source file containing a RESUMS command, and placing 
an entry: for this file in the appropriate Absentee Waiting Queue. 
Unshelving an AC is done by the Absentee Initiation Module in the 
sane fashion as initiating a new 40. However, since the absentee 
source file for this 40 consists of merely a BESUNE command to 
resume a SAVEA file, the waved AC is restarted. 7 


2.227 User Commands 

Users are provided with a detailed set of commands with which 
to control the initiation, operation, anf termination of absentee 
computations (see Chapter 1). . These commands cause calls to 
entries in the Absentee Monitor and status information is returned 
to the user in each case to indicate if the-calls are 


successful. 
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CHAPTER U 
Features of the Queueing neshan! en 


The Queueing Mechanim: consists of the Absentes hal ting 
Queues, Absentee Running Queues, and the Absentee Queue.Control 
module... This chapter describes the structures of the..various 
queues and the operation of Absentee Queue Control. 


During the operation of. the system, user requests to 
anitiate new AC's uur arrives faster shan the-new: AC's | 
can be initiated. One reason for this is. that the maximus 
number of AC*s which may run simultaneously may be limited, thus 
necessitating the placement of waiting requests into = waiting 
line or ne- Actually, a queueing mechanien cen be avoided: 
if 1t ie felt by the systen designers that if there ourrently is 
no room for more AC*s, then. the user shoul retry his request. 
at 2 later tine. This, in effect, is the method used in the 
case of new interactive users. If the new IC cannot de initiated 
the user must mit until a later tine and then reattenpt to log in. 
The::reagon for this choice is obvious. Sappese, for sxanpls, that 
an interactive user tries to log in and that the system cannot 
handle any more interactive users now. Suppose that the systen 
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then proceeds to enqueue this user's request in a waiting 


line with other requests for IC's. Clearly, there is no way 

to tell how long it 1111 be before the new request may be 
serviced, Thus, the user might sit faithfully. at his console 
for several minutes or perhaps several hours before his request 
may be serviced, From the humah factors standpoint: which is 
20 67yitical in the design considerations for a multiple-access 
computer systen, auoh an oourrende is not tolerabie, 
kopvever, singe a user does not have to be present to run 
his absentee computation, it is clear that requests for AC's 
may be enqueued for future initiation without any inconvenience 
for the user. As a matter of fact, in this way the user is 
assured that his AC will be initiated at the earliest possible 
time, As will become clear in Chapter 5, this feature of 
absentee computations is nost critical to the design and operation 
of the load-balancing mechanisn. 


4,2 Queve Discipline 

The order in which requests to initiate new A0“ are serviced 
heed not necessarily: be the same as the order in which these 
requests arrive, The method of choosing the next AC to be initiated 
from the queues is referred to as the queue disciplines. Among the 
more common queue disciplines are first=in-first~out (fifo) which 
selects ‘entries on a first-come-first-served basis, and last-in-first- 
ont (Ifo) whieh selects entries on a sestsourrent-firet=served basis. 
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The queue disoipline chosen for the Absentee Waiting Queues 
and Absentee. Running Queues utilizes both fifo and lifo disciplines 
in a slightly modified fashion. 


4.3 PirstoIn-Pirst-Out Disciplines 

Te C. T. 8. 8. system uses a fifo diacipline in which at 
most one absentee computation may. run at a tine. Once an ac 
has begun to run it nust be run to completion or until it is 
automatically logged out, No provision is made to allow the 
running computation to be temporarily suspended and then resuned. 
Absentee usage is never too significant a portion of total 
system usage since there is usually a single running absentee 
computation and as many as 30 running interactive computations, 
Hence, the suspension of the single absentee computation 16 not 
really a versatile tool in terms ef allowing nore ‘interactive 
usage to ocour, Figure 4,1 illustrates the C. 7. 8. 8. queueing 


mechani #a kor absentee computations. 


== — new entriesadded at back of queue 
WAITING 


ABSENTEE 
COMPUTATIONS N ae 
zl — Text entry to be initiated 


ABSENTEE 
COMPUTATION 5 “4— only one AC may run at a tine 
e. 17. 7.8.8. Absentee Queueing Mechani an 
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An obvious extension to the C. T. 8. 8. queueing mechani smn 


1 to allow many AC's to run at one time, This introduces some 
interesting load considerations since it ‘wight result in a syaten 
with a poor interactive response if the number of running AC's 
becomes large. This problem is discussed in detail in Chapter 5. 
Figure h. 2 illustrates a queueing mechanion which allows for 
many running AC's at one time. 


new entries added at. 
* back of queue . 


WAITING 
COMPUTATIONS 
1 —— next entry to be initiated 
RUNNING 
ABSENTEE “@——. many running AC's 
COMPUTATIONS | 2 (precise number of 
40˙% limited: dy the 
7 system's load control 
ame mechanisn) = 
Pigure 4,2 


Fifo Mechanism with Multiple Bunning Ac“ 
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. ate gon eae pe f 


Note that the structure of the mechanism of Figure 4.3 - 


atlows arbitrary criteria to be used in deciding the ordering 
of the entries in the runing queue. The 1ifo discipline is 
particularly useful for the extension made to this structure 
in the next section. 7 


4,5 Computation Streens 
Now let us consider the idea of shelving an absentee 
computation, Binde a uset is generally not present to control 
his absentee computation, the user does not suffer any 
ineonvenience if his computation 1s temporarily suspended 
and automatically femme. As hae been mentioned previously, 
“this property of AC's facilitates the design of the load 
balancing mechaniam presented in Chapter 3. In this section, 
the mechanism of Figure 4,3 is extended to allow the removal 
of an entry from the running queue and placement of this 
entry back into the waiting queue. =. 
Figure 4,4 illustrates this new mechaniam which is 
referred to as a computation stress. The stream consists of a 
first-in-firat-out queue of waiting AC's and a last-in-first-out 
queue whose entries point to the various running AC's, User 
requests for new AC's cause entries to be Placed at the back 
of the waiting queue, ‘The entry at the front of the waiting 
queue is next to be initiated. The entry at the front (last-in) 
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bottom of fifo waiting queue 


- QUEUE - 


top of fifd waiting queue 


5 the pa at the top of 
the neue is 
een it 18 15 Placed at 
dhe . e the waiting quae 
4 at the top 
of the waiting queue 18 
initiated; it 18 played | on 


top "SP ffr& fafff fd ha 


t 
ABSENTEE 
WAITING 
a 
1 


O 
O | 
O 77 carga eee dot ton of 1170 running queue 
pointers to 
running AC*s 
Figure 4,4 


A Computation Strean 
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of the running queue is the first to be shelved when any Ac“ 


are to be shelved, Also this entry, when shelved, is placed 

back onto the front of the waiting queue and hence it becomes 

the first entry to be initiated again when more AC's are to be 

initiated, The entry at the back of the running queue (firet-in) 

is the last entry to be shelved whenever AC's are to be shelved, 
This stream mechanism gives us the ability to increase 

and decrease the abseritee load ab‘dictated by the load 

. balancing ‘mechaniom, white at the sene tine sssuring automatic 

‘completion of al] AC's regardless of whether they are ever 

shelved for any reason. 


4,6. utat . 

Pigure 4,5 illustrates. the flow of an AC through a 
computation. stream. Since an AC may be shelved and unshelved 
many times as it runs, the entry for the AC may pass back and 
forth through the waiting and running queves until it. eventually 
reaches completion while residing in the running queue, Note 
that it 1s possible for an AC to leave the stream while it 1s 
in the waiting queue. This happens, for exemple, if the user 
decides to terminate the AC, Chapter 6 discusses user control 
of A0“ in detail, | 


30 


ABSENTEE 
WAITING 


QUEUE 
(PIFO) 


WALTING QUEUE FLOW 


1 (1) AC enters the stress 
{2i0t2 AC moves toward the 
| j 2ye(3) front of the waiting 
«2 queue as others AC's 
| before it are 
initiated 


23 2) AC moves toward the 
| (2)0(1) rear of the waiting 


69 — (3) (4) 15 is initiated 
25 (or unshelved) 
geile | (4)9(3) ac is shelved 


6321 ) AC moves towards the 
>) rear of the running 
queve as other AC's 
ini eisteg before it 
are completed 


! 
| | (Shot 5} ‘AC moves towards the 
(5)a(4) 


) front of the running 
queue as other AC's 
initiated after 4t 
are shelved 


(„) An AC may be completed 
) ess ofits 


seme relative positions 
in the running queue. 
Figure 4.5 


Flow of a Computation through a Streen 


It 1s apparent from the discussion of section 4,5 that 
a stream-type queueing mechaniam coupled with a load control 
meckhanian. which orders the shelving and witehelving of AC's 
ia @ useful means of ‘controlling the amount of absentee usage 
supported vy the system. An even greater degree of 8 
over the absentee usage is made aval aus ty utilicing a 
multiple stream queueing mechanism, Thus, 1t may be advantageous 
to differentiate between vartous types of absentee. computations 
(such as might be done in the implementation of a priority scheme) 
and-such a differentiation could be made by associating AC's of 
each type with a distinct atrean, Then, the load control 
“mechaniam could control the usage in each stream individually. 
‘These operations a described in detail in Chapter 5. 
Figure 4,6 illustrates a mutiple stream queueing mechanism, 

Note that no reference has been made so far to a means of 
ordering interactive computations or differentiating between 
various types. of IC*s, This has been so because our primary 
concern has been considerations related to absentee computations, 
The discussion of Chapter 5 indludes several such considerations 
of IC's, 
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CHAPTER 5 
Load Control 


When both interactive and absentee computations may 
run together in a multiple access computer system, it becomes 
necessary to apportion system resources and computing capability 
between the two modes, This chapter discusses how such an 
apportionment is made, adhered to, and dynamically adjusted 
by the system to maintain itself at efficient operating levels, 


1 Termin 

The sum total of the demands made upon the system's 
computing capabilities by all computations on the system is 
referred to as the system load. Depending upon the capabilities 
of the particular computer system in question, the system 
may operate efficiently over a wide range of ‘load situations, 
Generally, on a large-scale time-sharing system many 
computations may run simultaneously, but there is a limit 
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to the nber of. computations: mon the. arte dem support 
— vm „ Bas 

As a measure of system load we uss the number. of running 
computations, The stress lend in computation strean is the 
nuaber of running computations in that stream.’ The ptreem-dackup 
in a computation stream is the number Of. computations in the 
waiting queue for that stream. Stree backup is a neabure of 
potential stress load, The systen*s 1 configuration is a 
summary of the stress 1 and strom backup’ for each of the 
systen's computation stress. . N 

For any particular multiple access denpater systen, the 
most efficient load configuration (1.e., the load configuration 
which results in the most useful computation) is difficult to 
predict while the aystem is under development. After the | 
system besenes operational, however; efficient loa! configurations 
readily become apparent. -A tine eee coapater: anten is 
suid te de gropetly-loaded if 1t 16 operating mar its most 
efficient Lend configuration, overstosied if there te less 
useful computation being perrorwed than when the #ysten 1s 1 
its sost efficient load configuration, and underLomded if the 
addition of more computations would’ result in an increased 
amount of useful computation, These tern’ nay lo be used to 
describe the loed in a pomputation tren. In particular, a 
stream whieh‘normally services seven eompitations..is over-loaded 
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if nine computations are currently running in that stream, 
under-loaded with five running computations, and properly-losded 
with seven: running computations. . 


“The Load. canine. protien 12 to Sites the e 1 

an under-loaded state, the 104 eee ee 10 to. inorease 
decrease the ber of rupning computations, If a ersten 16 
operating in a properly-loaded state, .the ood. eqntrol problen 
is to maintain thie state, 


Cemaidag the losd contre). problem: in» ayatem deddoated. 
to servicing only-interastive: computations, The e load, L. 
1s equal to the ber of running IC‘... The. sxe! . 
are ataileble: to, the various, IC's, . t 40 dy- eee 50 
Limit the-nuaber of 1c to sone ri, Mie te prevent: bs 
syetem from becoming over-loaded. (My 10's. thersfore.corresponds 
to = properly-londed. state). The. fysten Aduiniatrator. specifies 
en initial value of ki at startup tine and nan alter Hy t 
. time during egsten operation. 
Figure 5.1 shows a sinple losd-contro). sehenden fer a 
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APPORTIONMENT: 
; REAPPORTIONMENT: 


administrator sets 
new value of M, during 
system operatian 
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NEW IC ATTEMPTS TO LOG IN: 
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es 
012017“ 


IC may not 
log in now 


RUNNING IC LOGS OUT: 


My, = maximum number of 
IC's allowed 
c 101-1 8 


Cy, = current number of 
running IC‘s 


Figure 5. 1 Load Control ina 
Purely Interactive 
System 
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purely interactive system, When a new IC attempts to log in 


Load Gentrol checks to see if the number of IC‘s, 0. 
currently on the system is less than the allowed narinun. 

If Cy is less than ki, the IC 18 allowed to log in and 

Cy is incremented by one. If C, is greater than or equal to 
M,.then the IC may not log in now; a new attempt to log in 
must be nade at a later tine. When a running IC logs out 

Cy, 18 decremented by one. 

The Systen Administrator may reset Mj, while the system 
is in operation. Load Control checks to see if My is less 
than Cy. If not, then no adjustments in the current IC 
load are needed, However, if My is less than Cy the systen 
automatically assumes an over-loaded state and i- 
running IC*s must be logged out to bring the IC load down toa 
properly-loaded state. Decreasing the number of running — 
computations is referred to as load trimming. 


ini Loe Trimming Strategies 
The most direct way to trim the IC load is to. immediately 


log out the necessary number of IC's, (Note that it ie therefore 
desirable to associate some ordering with the IC's in order to 
have a criterion for choosing which IC's to log out first, See 
section 3. J for a discussion of interactive computation streans. ) 
Such a strategy 1s referred to as a trim-by-force and is 
illustrated in Figure 5,2. 
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22. TNT ES 


In this example, the load is to be trimmed to P IC's... 
If 01 18 less than or equal to P then no adjustments in the 
load are needed, However, af C. is greater than P, then 
IC's are automatically logged out one-by-one until 0. equals P. 

From the systen's viewpoint, the load trim-by-force is 
a quick and sure means of decreasing the IC load, However, 
the trim-by-force results in inconvenience to the IC's which 
are logged out, since they cannot run to completion now, and 
they. may have to walt quite a while before they may log in 
again to continue their work, From the human factors 
standpoint it might be reasonable to adopt a continuous 
service policy towards IC's, This policy would then require 
a more flexible load trimming strategy which is referred to 
as load trig-by-attrition and is illustrated in Figure 3. 3. 

In this example, the load is to be trimmed-by-attrition 
to Pic's, If C, is already less than or equal to P, then no 
adjustments in the load are necessary, However, if Cy is 
greater than P. then the load is decreased to P as CI- IC's 
voluntarily log out, This is a gradual process, since the 
load decreases at the same rate as voluntary IC logouts, The 
IC's on the system at the time the load trimming begins do not 
‘undergo any inconvenience; they may run to completion and log 
out when they are done. However, once an IC logs out, it may 
not log in again until C1 becomes less than P. The 
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LOAD TRIM-BY-ATTRITION TO P IC's: 


wait for next IC 
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out 


A running IC 
voluntarily 
logs out 


Figure 5.3 Load Trin-by-Attriti on 
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Figure 5.4 Load Trimming Strategies 
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trim-by-attrition strategy does have one significant drawback. 


If the IC*s on the system do not log out in a short time, they 
can remain on the system as long as they would like to and thus 
prevent the load from being trimmed. In such a case it might 
be reasonable to impose some time limit on the voluntary | 
logouts, and if the load has not been trimmed to P IC's by 
that time, then a trim-by-foroe could be used to complete the 
load trimming, If it is required that the IC load be trimmed 
to P by a certain time, then the load trimming could be 
initiated in advance of this tine. Pigure 5. U 111ustrates 

the various load trimming strategies @iscussed in this section. 


Now consider the load control problem in a system dedicated 
to servicing only absentee computations. The system load, L, 
18 equal to the number of running AC's, The System Administrator 
specifies the maximum number of running AC‘s, My» at startup 
time and may alter l at any time during system operation. 

Figure 5.5 shows a load control mechanism for a purely 
absentee system utilizing the computation stream concept 
discussed in Chapter 4 When a user enters a request for an 
AC, Load Control checks to see if the number of running AC's, Cr · 
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M, = maximum number of 
rumning AC's allowed 
Cay = current number of 
running AC*s 
Coy = current number of 
‘walting AC's 


Figure 5.5 Load Control in a Single-Stream 
Purely Absentee System 
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is less than the allowed maximum. If c is not less than u, 


then the AC cannot be initiated now and must wait in the 
computation stream's waiting queue. The number of AC's 
waiting to be initiated, c, 
If Cy, 1s less than u then the AC can be initiated immediately, 


„ is inoremented by one. 


cr 18 incremented by one and an entry for this ac is placed 
into the computation stream's running queue. 

When a running AC logs out cr 18 decremented by one 
and the running queue entry for the AC 18 deleted, If this 
causes car to fall below ue then more AC's may be initiated. 
Load Control checks to see if any Ac s are waiting to be initiated 
and if so initiates enough Aces to bring the AC load back 
up to N.. 

The System Administrator may increase or decrease My while 
the system is in operation, If u is decreased so that at 
becomes less than Cay then Load Control orders. Cay-Ma AC's 
shelved, If u 18 increased to a value greater than 8 then 
Load Control orders M -r AC*s unshelved, Note that if the 
AC load has to be decreased (1. e., u 1s set to a value less 
than car) then it is reasonable to immediately shelve the 
necessary number of AC*s, The method of load trim-by-attrition 
need not be used since the shelved AC's do not undergo any 
inconvenience in the sense that a bumped IC does, ‘Thus the 
AC load is only trimmed by a load trim-eby-force, 
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Now let us extend the discussion of Section 5.3 to 
include the load control problem in a multiplesstream. purely. 
absentee ayaten. In particular, consider a system comprised. . 
of n absentee streams. The following. definitions. will be 
useful in the discussion: 


Maca) = recy number of Ac“ which may run in. atrean 
1 at one time 


* current number of “AC's roming in strean 4 


current number of AC's waiting to de run in 
stream i 


x Sd) maximum number of AC's. which may. run on 
21 the entire system at one tine 


R — are = ourrent number of AC's a on the 
Lei entire systen . 


Con 


01) * i 


* i = current muber of acts es to, be. 
iwi run on the systen 


The System Administrator apportions resources by 
- specifying M 401) for each stress. The: sm of these, N,. 
therefore represents what the Adminiatrator comsiders to be 

the maximum number of AC's which rey run at ome tine and still 
“keep. the system operating in a properly-loeded. state... In effect 
the Administrator specifies that M slots are. available for 


use by AC's, At any time a particular slot is either 

empty or in use. Since N running AC's represents a properly- 
loaded system, the load control problem 16 to maintain the 
system so that either M or fewer slots are ih use; If more 
than H. 406 are running Load Control must trim the load to 

n. If less than M AC's are running Load Control must 

check to see if any AC's are waiting and if 80 initiate 

enough AC*s to get the load back up to M. The functions to 

be performed seem clear, but the fact that more than one 
stream is involved introduces some complications. Por example, 
1t 18 possible that one streas could be properiy-loaded ant. 
all the other streams could be eupty. If there are AC's 
waiting to be run in the properly-losied strean, they must 
wait until running AC's in that stream log out before they 

may be initiated, This is obviously a waste of system resources 
since the “computing power" is available to handle more AC's 
and it 1s not being used. One solution to this problem might 
be to allow the waiting AC’s to run in other streams, This 

is satisfactory until such time as new AC's arrive and request 
to be initiated into streams which might be full of AC's from 
other streams, Should these new AC's also be placed into streans 
in which they too do not belong? In this section a strategy 
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is developed to prevent this sort of chaos while at the same 


time assuring that system computing power does not go to waste 
if there are waiting AC*s which could use that power, 

Recalling some definitions given in Section 3. 1 a 
particular stream is properly-loaded if C ar(1)™" a( a)? -under= 
loaded if (1K (1) · and over-loaded if 1 (1) The 
load in a particular stream is said to be balanced if the 
stream is properly-loaded, or if the stream is under~loaded 
and no AC's are waiting to be run in that strean. 

One aolution to the load control. problem in a myultiple« 
stream system might be to balance the load in each etrean 
independently of any considerations involving the other streams. 
This would result.in a system in which 

Cor (1) C Ha(1) for 1 1, 2. vn 
and hence it would always be true that 

n N 

B 2 01) 5 
The 1deal situation is R= M. However, the above gomponent- 
wise-balanced system may have R (I. even while there are some 
waiting AC's (4.e., the situation presented in the beginning 
of this section). 

To see how the situation in which RCM and Wz0 can be 
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avoided, let us trace the buildup of the load on a 
multiple-stream system starting with no running or waiting 
AC*s. As requests to initiate new AC's arrive, Load Control 
observes: that the current load in each stream is less than 
the allowed maximum and therefore allows the AC’s to be 
initiated, After a while, however, one of the streams will | 
eventually become properly-loaded. Suppose that. another 
AC requests to be placed into the properly~loaded stream, 
Load Control checks the load in this stream and discovers 
that the stream is full. Load control can then check the 
loads in the other streams to see if there are any available 
slots. If there is an available slot, Load Control allows 
this new AC to be initiated. This, of course, causes 
a properly+loaded etream to become aversloaded.. However, the 
system as a whole is not overloaded and therefore ‘by. initiating 
this new AC into an already properly-loaded stream we are 
preventing usable resources from going to waste, | 
Load Control may continue to allow new AC*s to be 
initiated until R becomes equal to H. Once this occurs the 
addition of another running AC would cause a genuine over-loaded 
situation, Now Load Control must first check to. see if the 
new AC wishes to be initiated into a stream which is either 
properly-loaded or over-loaded, If this is the case then the 
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new AC is placed into the waiting queut for that: stress bo avoid. 
over-loading the system. If, however, the seren into 

which this AC wishes to be placed is under-loaded, then 

some other stream must be over-loatied causing all slots to 


be in tse. The only reasoh that this other stream was allowed 
to use wore than ite maximum weder of gots was to prevent 
available resources from being wasted, Now, however, there 
is legitimate demand for these resources emi they should de 
given back to the AC which is specifically requesting then. 
This poses no real problem to Load Control. It is merely 
necessary to shelve one AC from the over-losded stream so that 
the needed slot. becomes available in which to initiate the 
new AC. This procedure is followed as efiditional AC’ request 
to de initiated until finally the system reaches a load 
configuration in which every stream 16 properly-loaded and 
there may or may not be AC's waiting to be initiated in any 
of the streane, This situation 16 referred be e ene 
idea) loot configuration for obvious reasons, = 

‘How consider the load control functions which must be 
performed when a running AC logs out. Since we mow that 
R wae always kept less than or equal to M as the 104 was 
building up, it must de true that a slot is made available 
(1.6, 2¢ oem not be the case that the syste went from 
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one over-loaded state to a less over-loaded state). Load 


Control must now decide which waiting AC (if there is any) 

to initiate into the newly available alot. First preference 
for the slot goes of course to any AC's waiting in that 
particular stream, Note that if the hene proposed in this 
section for initiating new 40 1s used, then it is not possible 
for an AC to be waiting in a stream which is under-loaded. 
Therefore 17 no AC is waiting in the stream in which an 

AC Just logged out, then Load Control must initiate one of the 
AC's waiting in any of the properly-loated or over-loaded 
streans, N 8 N N 

Thus we have arrived at a scheme for initiating: and 
shelving AC's which assures that available’ slots never go to 
waste if there is demand for them, while at the same time 

we have developed a mechanism which guarantees an AC first 
priority in ¢laiming slots allocated to the stream in which 
that AC wishes to run, Figure 5.6 illustrates the load 

control operations discussed in this section, The reapportionment 
function is treated separately in the next section because 
of its complexity in a multiple-strean system, 
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Figure 5.6 Load Control in a Multiple-Strean 
Purely Absentee System 
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PER i Se See erate ee 


In Sestion 5.5 requests for new AC's and logouts or 
running AC's were handled in an. orderly fashion to prevent 
the overall system from becoming overloaded, ‘fhe schene 
presented never requires the system te become temporarily 
overloaded while in the process of adjusting to its new 
104 configuration, When the system load is reapportioned 
by the System Administrator, however, each stream as ‘well as 
the entire system might become overloaded and thus at is 
necessary to provide a mechanism for quickly adjusting the 
overall system to a properly-loaded state, Besides the load 
trimming which may be necessary, it 1s also possible that 
the Load ‘balance within the streams may become . 
distorted by a reapportionment. In this ati en a strategy 
is presented for quickly and smoothly read qusting the system 
Load configuration after a reapportionsent. ‘The load control 
operati ens necessary for:reapportionment are tllestrated tn 
Figure’ 5.7. 1 

To effect the reapportionment, the System Administrator 
specifies new values of l, (1) through nan) : Load Control 
first checks to see if the overall system has assumed an 
overloaded state (R>M). If it has then R-M AC's are 
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Figure 3.7 nena Reapportionment in a Hul ti pl e- 
tream Purely Absentee Systen 
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immediately shelved from some of the over-loaded streans. 
Then Load Control proceeds. to belanse the rewainier of the 
load, an operation which is d u” later in this section, 
The queation arises here as to howto cheese AC's to be 
‘ghelved, Several criteria are useful in making this decision, 
but perhaps the most significant is to easume that there 


is some ordering emong the various atresns (1.6%, asu 

each stream corresponds to a different priority in a priority 
hee). Thus the -firat AC.to be shelved is one of the 

AC's in the over-loated stream of lowest. priority. ‘Similarly, 
a strategy to wae. for selecting A0 te be initiated might 

de to initiate an AC waiting in the ares of highest priority. 
Note that within the stream itself there te never any enbiguity 
as to which AC should be selected for shelving or initiation, 
The entry at the front of the waiting queue js always. the 

next to be initiated; the entry last-in to the running queue 
is next to be shelved. 

If. the reapportionment. causes the ‘overall systen to 
become properly-1 0 (E) then it is still possible that 
some adjustments have to be made ‘and the balancing mechani sm 
is invoked, } 

If reapportiomment causes the overall arten to become 
under=loaded (R<M) then the situation becomes move complex | 
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depending upon how many AC's are waiting to be initiated 

and whether or not these AC's are waiting in under-loaded 
streams, If the total number of waiting AC's in all streans 

is less than or equal to the under-load (M-R) then all the 
waiting AC's may be initiated and the reapportionment | 
operations are complete, If the number of waiting AC's is 
greater than the under-load then we must consider just how 
many of these waiting AC's are really entitled to be run in 
their respective streams. More specifically, we are interested 


Ain the number of AC’s which are waiting to be run in 


under~loaded streens, and of these we are only interested in the 
turk u (1 (1) raitusac“e in each stream (since 
initiating. more. than this. amount would cause the stream to 
become over-loaded). We refer to the number of AC's satisfying 


these conditions as the proper-demand, and define 


If the proper-demand is less than the under-load Load Control 
immediately initiates all of the proper-demand waiting AC's, 
Now R is still less than M, but every one of the AC's entitled 
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to be running is running, Load Control now initiates 
Ma. (B+ W, 5 additional 40 to bring the load up to M 
the 3 is complete. If. p is greater than 
the under=-load Load Control immediately initiates M«R of 
the proper-demand waiting AC's, vat the reapportionment is 
not yet complete since more proper-demand 40 are still 
waiting, and hence the load balancing mechanism must 
be invoked. ; N : 

rron the preceding discussion'#t 16 clear. that: the 
load balancing mechanism is called upon whenever Leet Control 
has ascertained that A, but there may still be some 
proper-demand waiting 10% which must replace AC's running 
in over-loaded streams, ‘The balancing han eheoks to 
see if there are imieed any proper~demand wetting AC's, If 
not. the reapportionment is complete; If there are then 
Load Control ‘shelves one AC from the lowest: priority over- 
losded stream and initiates one AC inte the highest-pricrity 
underlosded stream, This: procedure continues until there 
are no additional proper-denand waiting 408. 

To — ze sections 5.5 and 5.6, 4 mechantom-has been 
presented to perf en efficiently the load contre) operations 
required in a multiple-stream purely absentee ten. The 
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mechanism has the following significant characteristics: 
The System Administrator can coutrol the amount 
or absentee usage in each computation stream by 
specifying the maximum number of AC's which may 
run in that stream at one time. 

The mechani an prevents waate of available alote 
by allowing properly-loaded streams to become 


le 


over-losded as long as there is no demand for these 


‘Slots from AC's in the streams to whtch the alots 


del ong. 

The mechanism guarantees an AC first claim’ to 

slots in its own stream, If 411 stote on the 

system are in use when an AC requests one of its 
rightful slots then an AC 10 shelved fren one of 

the over-loated streams, : 

The System Administrator is provided with the ability 


do reapportion the loads in the various streams at 


any time during system operation. 

The ‘hechanism:is constructed in such a way aa to 
comply quickly and efficictently with reapportionment 
requests from the System Administrator, If a 


‘reapportionment causes the systen to assume an over- 


loaded state, the over-load is corrected quickly 
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50 that the ae ten operates with an over-1 ed for 


the shortest possible time, and then any balancing 

which mist be done to assure AC's first olaim to their 
own stream’s slots is done on 1 “bhoite-onesinitiate-one* 
basis to keep the system operating with all slots in 


use. 


Now consider a system devoted to servicing only 
interactive computations. One improvement which might be 


made to the scheme in Section 5.2 1s to consider that there 
is some ordering associated with the running IC's which indicates 
the next IC to be logged out in the event that such action 
ie indeed necessary, By analogy to the case of absentee 
computations we. define here the notion. ef an interactive © 
computation stream. Furthering. the anal ogy we assume that it 
is desirable for some reason (such as a priority scheme) to 
differentiate between various types of IC's, Thus we arrive 
at a multiple-stream mechanisn for handling interactive | 
computations similar to the absentee mechanise described in 
Sections 5.5 and 3.6. In this section we consider the 
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modifications which must be made to adapt the: absentee 
mechaniaa to the handling of interactive computations, 

Note immediately that there. are no waiting queues in 
the interactive streams, This is the case because a user. 
is only present for as long as it takes for his logging in 
attempt, Thus it is not meaningful to consider interactive 
demand at this level. 

Next consider the problem of attempting to f111 all 
interactive slots if the demand for them exists. If the 
systen loed operates. at ‘a level’ suth: that no stream ever 
becomes properly-loaded then the load control operations 
are identical to those in the absentes geshen en. However, 

. suppose ‘that one stream does become’ properlyslosded while 
some other streans remain under-loaded.: If a-new IC should 
request to be initiated into the properly-loaded stream, Load 
control has only two choices, Either it ean initiate the 
IC and over-load the stream, or it eat refuse to initiate — 
the IC (4.6. the IC cannot be placed into a waiting queue 
for an iniefinite period until @ slot. becomes avatlable). 

If initiation is refused then waste coours because an available 
slot goes umsed, If the IC ie initiated then this waste is 
‘prevented, but another problem arises, What happens when 
the overall system becones properly-losded (1. e., no more 
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available interactive slots), and a user attempts to log 


into an under~loaded stream? In the case of the absentee 
mechanism it was possible to make a slot available immediately 
by shelving one AC from an over-loaded stream, In the 
interactive case, however, making a slot available would 
necessitate logging out an IC from'an over-loaded. stream. 

This is contrary to the contimous. service policy discussed 
in Section 5.2. Several alternatives are available here, but 
unfortunately none of them is as Neat as the shelving of an 
40. ö 

1 = Do not allow any streams to become. over~loaded. 
Control the load in each stream independently of 
the load in any other stream, This results in a 
component-wi se-balanced system. The obvious 
disadvantage is that slots availatie in under-loaied 
streams oan never be used by IC’s from oversloaded 
streams thus causing waste of available slots. 

2 = Allow overflow in all streams. Initiate new IC's | 
into. whichever strean they request as long as slots 
are available in any of the stream, Once all slots 
are in use allow no additional 10 until slots 
again become available. This method assures that 
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available alote never go to waste, but has the 
disadvantage that IC's do not get first claim to 
slots in the streams in which the IC's specify they 
would like to run. 


3 = Allow overflow in all streans, Guarantee completion 
to all IC's once initiated. If a new IC requests to 
be initiated into an under-loaded strean then 
initiate the IC into that streem and trim the load 
in an overloaded stream by attrition, ‘This method 
prevents waste of available slots and assures IC's 
first cleim to slots in the streams in which the IC's 
specifiy they would like to run. The disadvantage 
is that the trinm-by-attrition might result in a slow 
trim and hence the overall system might be forced 
to operate in an overloaded state for some tine. 

Each of these methods has ite advantages and disadvanteges, 
but none of them is a “perfect” solution, Our inability to 
arrive at such a solution here is attributable to the fact 
that there 18 no action which may be perfermed on IC's to 
correspond to the shelving of AC's, Thus a particular 
Load Control implementation might choose. one of these schemes 
(or perhaps others) depending upon the particular problems 
at that installation, If we assume that the most desirable 


properties are preventing waste of available slote and 


guaranteeing IC's first claim to the slots in the streans 
in which these IC's wish to run, then we arrive at mother 
scheme (which is still, incidentally, not a perfect’ solution) 
which {s similar to the third scheme above, but prevents 
the overall system from becoming overloated: . 
4% = Allow overflow in all streaus, however, if an Ic 
18 initiated into = properly-loatted or overloaded 
stream then the IC 1s given second-class status and 
is warned that his computation.i1s likely to be 
‘logged out if the overall systen — properly - 
loaded and an IC demands. a slot in an wnder-Loaded 
stream, ‘This method does not assure IC's continuous 
service, but still allows an IC to get en end use 
a slot for as long as the slot is not in demand, 
Sinde the IC 1s warned of its second-¢lass status 
it knows that it 18 likely to de logged out and hence 
it can take advantage of being Togged in to get a 
small job done, Of course, as other IC's Log out 
of this over-loaded stream, the IC we are considering 
may eventually be able to be removed from the over-load 
portion of the stream, At this tine the system could 
inform the IC that it is no longer of second-class status. 
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We will assume that this last method is used for the purpose 
of any further discussions in this thesis, Again, other 
methods might be more desirable in particular installations, 
Now consider the reapportionment problem in a . 
multiple-stream purely interactive system. Since we are 
allowing streams to become over-loaded as long as the overall 
system does not become over=loadead, reapportionment. can | 
be handled rather straightforwardly, If the totel number 
of running IC's is less than or equal to the maximum allowed. 
then no action need be taken (note that there are no waiting 
IC's to be. considered as in the absentee case). If the 
total number of running IC's is greater than the allowed 
maximum then Load Control logs out IC's from the lowest 
priority over-loaded streams until the number of running IC's 
is equal to the maximum allowed, To aid the ICs ‘which’ 
aré to be logged out Load Control might warn them a few 
minutes in advance to allow them to “clean up“ any details 
before being forced off the system. 


— Co Li yeh RA BYOTIG 2 2 ae 
nterast 2 IDEEA 
In this section we combine the mechanisms developed 


for handling multiple-stream absentee systems and muitiple- 


stream interactive systems to form a mechani sm for handling 
mixed interactive/absentee i gare 3. 10 and 5.11). 

Plsure 3.8 illustrates a multiple-strean queueing 
mechanism for handling a mixed interactive/absentes system, ö 
For the purposes of this discussion we ‘assume that there 
are n absentee streams and m interactive streams, Note that 
there are no waiting queues for IC's, This is conaistent 
with our ‘previous discussion of interactive streans. 

. Figure 5.9 summarizes the paraneters used by Load. Contrel 
in making its various load balancing decisions, The reader 
is~urged to: familiarize hinself with = the definitions ‘ef these 
parsneters bbfore: prdeaeaihg-with The boizoans d soussion, 

Previously, we have considered systems whioh supported 
either ICts: or AC" but ‘hot both, In these syatens. the: . 
apportionment made by the System Administrator was said to 
divide the system into a certain number of slots, esch or 
which was capable of handling one running computation, It 
1s worthwhile to note here that we have ascael in this:Asvision 
that each slot 18, in some sense, of equal size. Thus we have also 
assumed. that regardless of the charaatertsttom-bf the | 
computations using the slots, ‘the actual denanis placed upon 
the system by these computations - 1 directly propertional to 
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. Figure 5.8 Queueing Mechanisa for a Systen with 
Multiple Interactive and Absentee e 
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the number of slots in use. This is obviously a simplifying 
assumption whieh can de avoided by providing a module capable 
of deciding just how big“ the slot need de to effectively 


service 8 particular computation, With #uth a wodtle available 
we could proceed to define an atouié-slot as the untt of 
computation size measurement, Computation streams could 
then be envisioned to consist of atomic-slots, and each . 
computation requesting to be run ina particular stream would 
be granted ‘an: appropriate number of atomic-slots in that 
stream, A stream would then ‘be considered properly-loaded 
if all or tte‘atomic-slote were in-use; N 

This problem was discussed here because we must again 
make a simplifying assumption, namely that absentee slots 
are the sane “size”. as interactive . slots, Fron the disoussion 
above we can envision ways of avoiding this assumption, too. 

The System Administrator apportions syeten computing 
power by specifying the naxi nun number of computations which 
may run in each of the absentee and interactive: streans. 
Reapportionment may also be done and is discussed later 
in this section, | 

When an IC attempts to log in to stream 3 (his nan) Load Contra. 
checks to see if the total number of running computations 
on the sys tem is less than the maxinun- number allowed. If 
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Figure 5.10 Load control in a System with Hul r1 51 e 
Interactive and Absentee Computation Streams 
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ar is indeed less than ur then the IC is initiated 
“Ammediately, Mote that Load Control proceeds to check - . 
whether stream 3 is now over-losded,-ani if it ts over-loaded 
the user is warned that there is a possibility hie 1c 
may be logged out (since the slot taken by hts: ‘IC really N 
belongs to another stresn). If the systen 15 now full 64.6, 
Bn is equal. to’ My) ‘then Lead Contre. ‘cheeks Tf the’ AntetRotive 
“portion” of the aysten is I. If not then elearly sone 
absentee stream is overloaded ‘ona ‘Lead, Contre] shelves: one 
computation from the lowest prierity over-Loaded etre end 
initiates the IC into stream j acein checking. at j is 
over-Losded apd warning the user if it is, Ir the interactive 
portion of ‘the system is full, Load Control 1 at. stream 3 
to see if it is full. If stream J is not full then clearly — 
one of the interactive streana is over-loaded and Load Control 
logs out one IC from the lowest priority overcideded interactive 
stream and initiates the new Ie into stream. 3. if stream 7 
1s full tee Leed centres informs the user that he may not 
log in at ‘this time,. Note that one further ‘giternative Aa 
still available to Load Control for attempting to initiate 
this IC now. Load Control could check Af. any stream with . 
Tower priority than stream j is. overloaded. and if so coald 
then log one 10 out of this stream and initiate the-new IC. 
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This alternative is avoided here mostly because of our 
efforts to provide continuous service (if at all possible) 
to running IC's, 

When a new AC requests to be run in stream j (1g) 


Load Control cheoks to see if the system is full.and, if not, 
initiates the AC immediately. Note that no warning need. 

be given to an AC if stream j is overloaded. If the. 
system 16 full Load Control cheoke if the absentee. portion 
of the system is full. If not, then clearly some 
interactive stream is over-loaded and Load Control Logs out 
an IC from the lowest priority. over-loaded interactive stream 
and initiates the AC into stream 3. If the absentee portion 
of the system is full Load Control checks if stream J 1s 
full. If not, then clearly some other absentee stream is 
over-loaded and Load Control shelves one AC from the lowest 
priority over-loeded. stream and initiates the new AC into 
stream J. If stream j is full, then the AC may not be | 
initiated now and Load Control places the AC in the waiting © 
queue for stream 3. 

Note that this discussion and the ‘diagress of Figure 5.10 
have been simplified by the omission of some of the queue 
mani pul at on details prevalent in previous discussions, Thus 
when a computation is said to be initiatea or shelved in 
this discussion it is meant to be implicit here that these 
manipulations are perf orned when appropriate. 
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When an IC logs out of stream j Load Control checks if 


any AC's are waiting. If there are none then no operations 
are performed, Ir there are AC's waiting then Load Control 
initiates one AC, | 
When an AC logs out of stream J Load Control checks if 

any AC's are waiting in stream 3. If. there are then Load 
Control initiates one AC into stream j. If no AC*s are 
waiting in stream j Load Control checke if Ac“ are waiting 
in any other absentee streams, If there are then one AC is 
initiated, . . | 

note that in a system in which the load builde up 
under the control of the above mechanism. the oversil. system 
never becomes overloaded and no AC 48 ever placed into a waiting 
queue if slots are available in the stream in which the 
AC wishes to run, Reapportionment; however, can cause both 
or these conditions..to:‘ocour’and the ‘methods of alleviating 
these problems will now be discussed, 


Figure 5,11 illustrates the operations which must be 


performed by Load Control to smoothly effect a load 
reapportionment ordered by the System Administrator. The 
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mechani sm is designed to provide continuous service to those 


computations which are entitled to continue rumning under the 
nen apportionment, while, at the same time, quickly | 
eliminating (1.e., shelving AC's and logging out IC's) those 
computations which should no longer be allowed to run, The 
strategy employed involves first inoréasing: or decreasing 
the current load until the proper number of slots are in use. 
This results in the system becoming properly-loaded under 
the new apportionment. ‘Then Load Control proceeds to lopate 
any AC's which should be running. If the overall system is . 
stitl under-loaded when this procedure begins then Load - 
Control initiates enough of these AC's to bring the system 
up to a properly-loaded state. Once the system is properly- 
loaded if: any more waiting AC's should really be running then 
clearly some streans are over-loaded. Load Control. N 
eliminates one computation from an over-loaded stream and 
initiates one of these AC's, This procedure continues util 
no more of the waiting 40% should be running. The N 
following disoussion considers these operations in more 
detail. 5 

The Administrator effects « reapportionment by 
respecifiying the maximum number of computations which may | 
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run in each stream in the system. Load Control first checks 
if the total number of running computations is greater than 


the. maximum allowed under the new apportionment. If Br is 
greater than Mr then Load Control must eliminate computations 
from overloaded streams to get the load dem to Myo Tr the 
nanber of running AC's, E, is Yeas -than or equal to the 
matinum number of AC's allowed, k, then the total overload 
is made of IC*s, Load Control logs out B,-M, of the IC's in 
over-loaded interactive streams (begining with the lowest 
priority streams), .Onée these IC's have been logged out the 
system is properly-loaded, However, 1t is still possible that 
the reapportionment caused some of the waiting AC's to become 
propor- waiting AC's and hence Load Control invokes 
‘the balancing mechanism to initiate all proper-demand waiting 
AC's and log out enough over-lomd..ctapatations:te-keep:the- 
syeten. trom vecoming, over-loaied, 

If B. is greater than M, then some AC‘s must be shel ved. 
In particular, if the absentee over-lodd is greater than the. 
total system over~load then R- AC*s are shelved, If the 
absentee over-load is not greater than the total system 
overload then all over-load AC’s are shelved and then 
enough over-load IC's are logged out to bring the total 
systen load down to Mp. In each of the above two oases 
the load-balancing mechanism 4s invoked after the eliminations, 
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Up to this point we have: deen considering cases an: 


which the overall system is overwltoaded. IF ‘after the 
reapportionment the overall syeten becomes ‘properly loaded 
(RpaM,,) then it is still possitie that some AC's have 

become proper-demand waiting 40 and hence the 10 
balancing mechani sn is invoked. Bory 

If. the reapportionment causes the overall system to- 
become under-loaded then Load Control mist first ‘bring the | 
system up to a proper-losded state if there is enn ac 
demand. Tf the number of waiting. Als As leas. than or 
equal to the system under-load,; then all. waiting AC's are 
initiated and we are done; If there are mare waiting AC's 
many of these 40 are proper~demand waiting ‘AC's, If the 
number of proper-demand waiting AC's 1s greater than the 
under-load then Load Control initiatesencugh of thess to get 
the system up to a properly~loaded state m then invokes 
the load balancing mechanism to initiate ell of the remaining 
proper-denand waiting AC's, If the number of propexadenand 
waiting AC's is lesa than or equal: to the unter=Loat: then. 
Load Control initiates all or the proper=iemand waiting AC's 
and then initiates enough of the remaining AC's to lag the 
overall syeten up to a properly-loaded State end we.are done. 


76 


FFF 


The load balancing mechanism is only invoked 11880 . 
the overall system load is equal to the maximum losd allowed 
under the new apportionment, The mechanism checks if there 
are any proper-demand waiting AC's. If not then we are 
done, If there are proper-denand waiting AC's then clearly 
some stream is over-loaded, We know at this point that 
all slots are in use, Thue it iust be true that etther 
AC*s. are using a1 Ac slots and I¢'s are 19180 all 10 slote, 
or one of the modes is using more than ite allocated number 


of slots. If both modes are using their allocated slots and 


there are proper-demand waiting AC's then clearly some 
AC's are running in over-loaded streams, Load Control 


‘shelves one of these over-load AC s and initiates one proper~ 


demand waiting AC and repeats this process until all proper~ 
demand waiting AC's have been initiated. If AC's are using 
more than their allocated number of slots then the balenoing 
procedure is the same as 4f both modes are using their allocated 
slots, However, if IC's are using more than their allocated 
slots then Load Control logs out one over-Load IC and initiates 
one proper-demand waiting AC. This process continues until 
either the number of rumning IC's is equal to the maximum 
number of IC's allowed or all proper-demand waiting AC's are 
initiated. If the first condition is satisfied first then 
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there may still be some proper-demand waiting AC's, Load 
Control handles this by shelving one over-load AC and 
initiating one proper-demand waiting AC and continuing 
this process until all proper-demand waiting AC's have 


been initiated. 
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CHAPTER 6 
Commands for use with Absentee Computations 


Users of the computer system communicate with the 
system by issuing commands (usually in the form of 
typewritten statements) at remote terminals, This chapter 
discusses a set of commands used by system users and 
administrative personnel to create, monitor, and terminate 
absentee computations, The 44868540 here is less detailed 
than in Chapters 4 and 5; it 1s indluded to illustrate 
what functions night usefully be controlled at the command 


level, 


6.1. Creating an AC ee 

Creating an AC involves two functions, First, the 
identification of the user must be validated to prevent 
unauthorized access to the system. Second, the user must 
inform the system of the absentee source file which is to 
be used for input to the computation, and the absentee output 
file which is to receive output from the computation. 
Additional parameters are supplied to specify in which 
stream the user wishes his AC to be run, the time Limit. 
to be placed on the running AC to prevent waste if the AC 
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develops problems while the user is not present, and 


perhaps the user may wish to give a date and time before 
which his AC should not be run (useful if it is known that 
data needed by the AC will not be available until that time). 
The CREATE~ABS command is provided for users to create 
AC's, CREATE-ABS may be used by an IC or an AC belonging to 
the user creating the new AC. ‘since the. computation. must 
already be logged in there is no identity validation necessary. 
CREATE-ABS results in a call to Load control which either 
initiates the computation immediately or places it into the 
waiting queue for the specified stream depending upon the 


current. system load. 


6,2 Te * 2 

Every computation, upon completion must undergo an 
orderly logging out procedure to remove the computation 
from the system and take care of certain "cleanup" problems. 
In addition, it 1s sometimes desirable to be able to bring 
a computation to an early end (such as when the user discovers 
he has left en AC running with bad input data). 

mme TERM-ABS command is provided to perform both 
the nornal-end and early-end functions for AC's, The user 
specifies the computation-identification of the AC to be 
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terminated, Load Control is oglled upon to search the 
queueing mechanism to see if the AC is waiting to be run, 


running, or no longer on the system (either it is done or 
the computation-identification was incorrect). If the 
AC 1s waiting to be run then the entry for the AC in the 
waiting queue is deleted, If the AC is currently ruming 
then it is stopped immediately and logged out, If the 
AC is not on the system then the user is 80 informed, 
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_ When the system is heavily loaded the user may find 
that his AC's take longer to run to 6ompletion. To speed 
up the processing the user may wish to place the AC into 
a higher priority stream (for which he may be charged more 
put will get better service), 

The CHANGE-STREAM command is provided to remove an 

Ac from one stream and place it into another. The user 
specifies the computation-1dentification of his IC, the 
stream it 18 currently in, and the stream into which 1t 18 
to be placed. Note that the CHANGE-STREAM command 4s also 
useful for switching IC's from one interactive stream to 


another. 
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6,4 ¢ wie n_AC 
A user may wish to run a large computation as absentee 
but in order to be sure that he has set the computation up 


properly he may want to run it interactively for a while, 
Once the computation gets going successfully (perhaps the 
user notes that the proper output is being generated) then the 
user may convert this running computation ‘to e 

The CONVERT command is provided to enable a user to 
switch a running IC to an AC. me user first presses the 
WIT“ button at his terminal to stop the computation so 
that the CONVERT command may be typed, 


6,5 Con ac _to ic 

The user may. wish to monitor the progress of one 
of his AC's for a while to make sure that it is. running 
smoothly, or perhaps to user would like to make some changes 
in the absentee source file or other data supplied to the 
AC. 

The CAPTURE command is provided to allow the user to 
capture control of one of his AC's so that it can be controlled 
from the user's terminal, Note that the user may wish to 
finish. the computation interactively or he may wish to issue 
a CONVERT command to allow the computation to finish as absentee, 
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Note that by using CAPTURE and CONVERT the user may 
actually control several computations at one time from a 


single terminal, This is particularly convenient for 
computations which may need only minor intervention. 


6,6 Obtaining Status Information for a. User's Computations 
A-user may have. ‘Many computations. running. at one time 


and may have many absentee tomputations in the waiting queues 
waiting to be run. The user may want to monitor the progress 
of these computations and find out if it might be necessary 
to intervene (via CAPTURE and CONVERT) with some of then 
to correst any error conditions which might exist. Also 
the user may find that some computations are running too 
slowly and thue it may be desirable to issue a CHANGE-STREAM 
‘command, 7 

The STATUS command is provided to give the user 
information about his various computations on the system. 
STATUS may be used either to find out about a specific 
computation, a group of computations, or about all of this 
user's computations, Information is returned to the user 
indicating how much time each computation has used, mat 
dedicated resources are being used by each computation, when 


each computation was initiated, etc, 
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6,7 Requesting Intervention by an IC 

‘Normally, if an AC develops problems while it is 
rumning it cannot be run to completion because it needs. 
information which is unavailable to it in the absence 
of its owner, However, if a user who submits an AC happens 
to also be running interactively when such trouble occurs 
then it is possible that the user will be able to supply 
the necessary information (or corrections) to the AC so 
that it may run to completion. 

The INTERVENE command is. provided to aid an interactive 
user in specifying that he is available to aid his AC’s if 
trouble develops, Sometimes_the nature of the interactive 
user's voxk would make it undesirable to be interrupted by 
a call for help by an AC.and in such a case INTERVENE would 
not be issued by the IC. An interactive user uses CAPTURE 
and CONVERT to effect an intervention. 


6.8 Specifying the AC-IC Load Apportionpent 

The Sys tem Administrator must specify the apportionment 
or system computing power between the various computation 
streams on the Arten- 


The LOAD-SPEC command is provided to allow the 
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System Administrator to make à load, apportionment or 


reapportionment, The initial load apportionment is 

performed at system startup time and reapportionments 

may be done whenever necessary. If for a particular 
application the apportionnents should be the same for 

certain regular periods (shifts) then the System Administrator 
may specify apportionments for each of these shifts and 

Load Control will keep these available. Whenever the 

time for a new shift arises then Load Control. will dynamically 


reapportion the system. in the manner discussed in 
chapter 3. 


Administrative versonnel may find the STATUS and 
TERM-ABS commands useful, STATUS may ve used to obtain 
status information for any computation on ‘the. entire ersten 
and TERM~ABS may be used to terminate an Ac which 
appears to be causing probl ens (such as tying up certain 


resources), 1 
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CHAPTER 7 


The work described in this thesis was:cohsentiated in 
two areas; a general discussion about the-charactertstics 
of absentee computations, and the design er a mechahisn ‘for 
nandl ing absentee computations in a multiple-access computer 
system. 

Perhaps the most significant contributions of the 
thesis are the concepts of shelving and unshelving absentee 
computations, the concepts of absentee and interactive 
computation streams, the design of the multiple-stream 
queueing mechanism, and the design of the 1004 control 
mechanism for hybrid multiple-strean interactive/absentee 
systems, N . . 

The design of the combined queueing and load control 
mechanisms has the following significant characteristics: 

1 - The System Administrator may apportion the computing 
capability of che system between interactive and 
absentee compatations in any proportion whatever. 
This allows the system to be 100% interactive, 
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100% absentee, or any intermediate combination 


of the two modes, 

The computation stream concept allows computations 
of different types“ to run in different streams, 
One such differentiation nicht be a priority scheme 
in which each streem contains all the computations 
of a particular priority. 

Absentee streams have the property that running 


' computations may be témporarily suspended and 


restarted (shelved and unshelved) several tines 


as they flow through the stream. This property 


18 one of the keys to the suecess of the load control 


mechanisn. 

The multiple-strean mechanism has the property that 
the load in each stream 18 individually controlled. 
The multiple-stream mechaniem maintains a precise 
ordering among aii computations whether they be 
interactive or absentee and waiting or running, 

For example, in a priority scheme the computation 
atreams are ordered by their respective priorities. 
Within. each computation stream waiting computations 
are ordered by virtue of their position within the 
waiting queue (first-in-first-out discipline is 
used in this work for choosing the next entry), and 
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running computations are. ordered by virtue 


of their position within the running queue (last-in- 
first-out.-digcipline is.uged in this work), 


Thus, Ar at any tine the load control mechanism 
‘wishes to eliminate or initiate a computation, the 


choice of which computation to eliminate or which 

to initiate is determined by the ordering described 
above, Thus. the load control mechanism is made 

more efficient than 1t would. be af the above choice 
was not always predetermined. | | 

The load control nechani an prevents waste of available 
computation slots by allowing streams to become 
overloaded zr slots in other streams are unused. 

At the sake time, the mechantsm assures. computations 
in a pertiotlar stream first.-olein to slots which 
have been specifically allocated to that stream, 
Thus stream i cah become -over-loaded by using 
available slots in stream 4. However, if the 

demand builds up again in 3, then the over-load 
stream 1 computation must relinquish the usurped 
slot and 18 either shelved if it is absentee or is 
logged out if it is interactive, 


7 Finally, the load control mechanism 


effects load reaprortiennents quickly 

and smoothly. If a conputation: running 

before the reapportionment ‘should also 

run after the reapportioment, load control 

carefully avoids ‘either shelving or logging 

out the computation. Initiation of waiting 

computations. and elimination of running 

somputations is done quickly because the ordering 
. described in (5) above makes the selection 

such computations trivial, 

It is worthwhile to note here that there are two obvious 
levels at which load cohtfol decisions can be mate, namely 
the admission level and the scheduling level. At the admission 
level decisions are made regarding which AC's and IC's. shall 
be allowed to log in to the system. At the scheduling level 
decisions are made regarding which of the logged in AC's and 
IC*s shall be the next to be given a processor when one 
becomes available. The mechanism designed in this work 
operates at the admission level only. Once this load 
control mechanism allows a computation to log into the 
system, the computation must then fend for itself in the 
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competition for processors, At this higher level decisions 


must be made on the basis of less specific information and 
must be intended to be enforced over longer periods of time. 
The apportionment we speak of would probably be in force 
for at least several hours at a time, and the load control 
mechanism we propose might be reasonably certain to assure 
that actual usage closely approximates the apportionment 
in the average over such a long period, 

Recalling the simplifying assumptions made in Chapter 
5, namely that each slot is the same size regardless of the 
particular traits of the computation using the slot, we see 
that perhaps it would be useful to have our load control 
mechanism receive information from the scheduling level, Such 
information combined with an atomic-slot mechaniam as 
discussed in Chapter 5 would help to provide much. more 
precise control over the system load than the mechanism 
proposed in this work. The design of: such a mechanism is 
suggested for those interested in pursuing research in 


this area, 
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